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C$ ■ We prove that a random 3-SAT instance with clause-to-variablc 

density less than 3.52 is satisfiable with high probability. The proof 
comes through an algorithm which selects (and sets) a variable de- 
pending on its degree and that of its complement. 

> 

0\ ■ 1 Introduction 

There is much interest in understanding "phase transitions" in mathematics, 
£T) , computer science, and mathematical physics, and in particular the £;-SAT 

phase transition. In the standard model for random £;-SAT, a random k- 
■ CNF formula F(n, en) with n variables and density c has m = cn random 

clauses independently selected uniformly at random, with replacement, from 
among the 2 fc (^) proper clauses of length k. The Satisfiability Threshold 
Conjecture asserts that for each k 2, there exists a constant such that 
for all constants c < c&, F(n,cn) IS Si. a. s. (asymptotically almost surely) 
satisfiable, while for c > Ck it is a.a.s. unsatisfiable. 
C$ ' The case of 2-SAT is well understood, with Chvatal and Reed |CR92j . 

Geordt |Goe96j . and Fernandez de la Vega |FdlV92j independently proving 



that C2 = 1, and Bollobas, Borgs, Chayes, Kim, and Wilson |BBC + j deter- 
mined the "scaling window" to be 1 + B(n _1//3 ). For k > 2, the conjecture 
remains open. Friedgut proved that for any k and n there is sharp threshold 
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Cfc(n), leaving open whether Cfc(n) has a limit c\~. With the threshold be- 
havior not understood, considerable attention has been devoted to proving 
density bounds below which a formula is a.a.s. satisfiable ("lower bounds" 
on the putative threshold) and bounds above which it is a.a.s. unsatisfiable 
("upper bounds"). For k = 3, it is conjectured that C3 « 4.2, and the best 
upper bound is 4.596 j USVOO] . 1 

Existing lower bounds for 3-SAT are all algorithmically based. (By con- 
trast, new lower bounds for /c-SAT are based on the second-moment method 
|AM()2[IAT03] .') The earliest such bound of 1.63, due to Broder, Frieze and 
Upfal |BFU93j was based on the "pure-literal rule" : successively setting to 
True literals whose complement does not appear, "reducing" the formula, 
and repeating. The next, 3.003, due to Frieze and Suen 
"shortest-clause rule", setting True a random literal from a random short- 
est clause. Skipping over a bound of 3.145 by Achlioptas |Ach00j . a bound 
of 3.14 due to Achlioptas and Sorkin |AS00j again selects a literal from a 
shortest clause, but when the literal is from a 2-clause (the case of interest) 
it sets the literal either True or False depending (optimally) on the num- 
ber of other occurrences of the literal and its negation in 2- and 3-clauses; 
jASOOj extends this to a version which optimally chooses to set one or two 
literals at a time, and sets them optimally, for a bound of 3.26. AS00 
suggests that better bounds may require looking at literal-degree informa- 
tion, in some way harking back to |BFU93j . This approach was taken up 
by Kaporis, Kirousis, and Lalas |KKL02j . whose algorithm sets a variable 
of largest degree (a "1-parameter heuristic") to give a bound of 3.42. It was 
clear that the same approach could be exploited further. 

2 Result, significance, and open problems 

In this paper, we choose a variable according to its degree and that of its 
complement (a 2-parameter heuristic), to get a bound of 3.52. Kaporis 
and Lalas |KL| . using a similar but not identical heuristic, independently 
obtained the same bound at around the same time. The purpose of this 
short abstract is twofold. 

First, since the bounds from all heuristics of this sort rely on numerical 
calculations (notably, solutions to differential equations), it is important to 
put on record that our calculations and those of |KL| independently justify 
a value of 3.52, and that we reproduce the 3.42 bound of |KKL02j . 

X A bound of 4.506 due to Dubois, Boufkhad, and Mandler IDBJVLOOl has not appeared 
in journal-refereed form. 
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Second, our heuristic (and that of |KLj ^ efficiently solves denser random 
instances than any other theoretically justified algorithms; since solving 3- 
SAT instances is of practical importance, our algorithm may be of practical 
utility. In that regard, a few remarks. Our heuristic succeeds only with 
a probability that is asymptotically bounded away from 0, but exploiting 
a standard one-step backtracking trick brings the asymptotic probability 
to 1. Also, the algorithms commonly used in practice are Davis-Putnam- 
type backtracking procedures, quite different from the "greedy" approaches 
taken in all the works described above. However, it is easy to imagine using 
the present heuristic as a selection rule for a Davis-Putnam algorithm, pre- 
serving the heuristic's theoretically justified behavior on random instances, 
while gaining the Davis-Putnam algorithm's guarantee of a correct answer 
on arbitrary instances. 

Not present in this short abstract is a rigorous justification of our proof 
methodology (fairly easy and familiar), nor of the numerical calculations, 
which to be done rigorously would require theoretically derived Lipschitz 
bounds on a derivative, and interval-arithmetic calculations employing those 
bounds, along with a few other technicalities. 

Future work could include consideration of a variable's number of ap- 
pearances and that of its complement separately in 2-clauses and 3-clauses 
(a 4-parameter heuristic), which is analyzable in the same framework. In 
at least the 2- and 4-parameter versions of literal-degree heuristics (as op- 
posed to the 1-parameter version), it is not clear how best to select a next 
literal: does a (2, 3) literal (2 positive appearances, 3 negative) trump a 
(4,5), or vice- versa? In the 4-parameter version, it is also not clear how 
best to set a chosen literal; this was the question answered in |AS00| for the 
non-degree-spectrum case. An optimal solution to these questions would be 
a most interesting theoretical contribution, and could also give significant 
improvements in the bounds. 

3 Algorithm 

We call a variable with % positive and j negative appearances an 
variable. Our algorithm is defined as follows. 

Algorithm A 

Input: A 3-CNF formula, 
begin 

1 while there exists an unset variable 

2 choose an (i, j)-degree variable using a selection rule 

3 set v True if i < j and False otherwise 
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4 while there exists a unit clause 

5 set a literal of an arbitrary unit clause True. 

6 if an empty clause is generated report failure; otherwise report success 
end 

The best selection rule we found was this. If there is a "pure" variable 
(one with i = or j = 0), select it. Otherwise, choose a variable with 
maximum discrepancy \i — j\, breaking ties in favor of maximal i + j. (This 
identifies a unique unordered pair {i, j}, and all variables with those degrees 
are indistinguishable to the algorithm.) This selection rule satisfies formulas 
up to density 3.52. Other selection rules we tried were less good. Working 
as above but breaking ties in favor of minimal i + j only worked up to 
density 3.50. Selecting by maximum i/j instead of i — j only worked up 
to 3.44. Selecting by maximum max{i,j} is equivalent to the approach of 
|KKL02j . and we reproduce their 3.42. 

4 Analysis 

In truth, the "natural" algorithm above is not the one analyzed. Rather than 
making O(n) iterations, the analyzed algorithm makes a constant number 
of iterations, in each of which it sets O(n) variables with common degree 
{iJ}- 

It is easily verified that during the algorithm, the formula remains uni- 
formly random conditioned on its degree sequence. To make the calculations 
finite, we truncate the degree sequence at some value h (h = 31 in our calcu- 
lations). Then with n the original number of variables, for i,j<h we let riij 
be 1/nth the current number of variables of degree (i,j); nhj (and n^/j) the 
similar value for variables with ^ h positive (negative) appearances; and 
n-h h that for variables with ^ h positive and negative appearances. Set- 
ting a single (i, j)-variable produces straightforwardly computable expected 
changes A (detailed in Appendix A) to the /i 2 -dimensional vector S of val- 
ues njj, and each element of A has order only 0(l/n), so the differential 
equation method (see for example |Wor951 ) can be used to prove that, as we 
set 0(n) variables with common degree the vector riij almost surely 

almost exactly follows a trajectory described by the solution of a differential 
equation corresponding to A. 

So instead of selecting an (i, j)-variable as in Algorithm A, we use the 
same selection rule to select a pair (i,j), i,j ^ h, and we set n ■ min{5, riij} 
(i, j) -variables at once. Here 8 is a value of our choosing, which could vary 
from round to round, but which we fixed at 10 -6 . Each such round (in- 
cluding the unit-clause steps it implies) can be described by the differential 
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equation method, and our analysis simply consists of simulating the differ- 
ential equations for a constant number of rounds. It is clear that after some 
number of rounds, all the values in S can be made arbitrarily small, and at 
that point we apply the main theorem of Cooper, Frieze, and Sorkin |CFS02| 
to show that the remaining formula is satisfiable a.a.s. (The positive side 
of their result has a natural algorithmic interpretation, so our procedure 
remains algorithmic to the end.) 



5 Differential Equations 

In this section, we describe the differential equations for the case in which 
we have a 2-dimensional table for keeping the expected number of variables 
with k < h positive appearances and I < h negative appearances. Since 
dt (the "time parameter" described before) is very small, w.l.o.g. we can 
assume all values of S remain fixed during a round. Using these values, we 
obtain the new value of S after a round. Suppose we set a variable from cell 
rik i True (in other words, set a (k, Z)-degree variable True). Then writing 5 
to denote the expected increase to a parameter, for such a "free move" we 
have: 

3 • m 3 . 3 • m 3 
dm 3 = -k— /— — , 

2 • m 2 ,2 • m 2 3 • m 3 
Sm 2 = —k— I— — + I— — , 

2~"m. Z-'m. 



8m,] = I -, and 

V 



-'III 



5nij = -il)(i,k)il){j,l) - k 



2 • 1 • m,2 + 3 • 2 • 1713 



(i + j) ■ mj - (i + 1) • rij+ij - (j + 1) • Ujj+i 

y ' 

where S m = S n = 2 • m.2 + 3 • 7713 is the total density of appearances of all 
variables and mi is the expected number of unit clauses generated by this 
free move. Here ip(x, y) = 1 if x = y and zero otherwise. Note also that 
since by definition mi = at the start of a round, at the end, mi = 8m\ as 
given above. 

After a free move, we have a number of "forced moves" in which the 
literals in all mi unit clauses must be set True to satisfy our formula. A 
literal in a unit clause is a variable from cell (k + l,l) with probability 
(fc+i)rc.fc + i ; ; ^ or negation of a variable from cell (k, I + 1) with probability 
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(i+i)n kJ+1 ^ ^ either case, in the rest of the formula (excepting the unit 
clauses) that variable has degree (k,l). Thus the expected number p of new 
unit clauses produced by one such forced move (the Malthus parameter in 
our Galton- Watson process) is 

E (k' + l)n fc / + i,z/ , 2 • m 2 (I' + l)n fc /,;/+i , 2 • ro 2 
v y, Y. Tl ' 

where Z'^p 2 (see parameter m\ defined above) is the density of new unit 
clauses after setting a (k', ^-degree variable True (which happens with prob- 

(fe J '-(-1)71 I ! 9 

ability v si ) and fc '^f is the densit y of 

new unit clauses after setting 

a (A/, /')-degree variable False (which happens with probability - +1 ^ fc/ - i/+1 y 
For such a forced move, the expected parameter changes are: 

Sm 3 = 2^ v SM 3 (k,l,T)^ SM 3 (k ,1 ,F), 

0^k',l'<h n n 

J m 2 = ^ ^ '-dM 2 {k ,1 ,T) H dM 2 (ft,/,F), 

where 5M 3 (k', I', T) has exactly the same formula as dm 3 defined above, 
likewise for 8M 2 {k' ^ I', T) and 5m2, and where by symmetry 8M 3 (k', I', F) = 
5M 3 (l',k',T) and 5M 2 {k',l',F) = SM 2 (l',k',T). 
Finally, for each i and j, 

8>n hJ = £ ^^ (^(^/.T) 

0^k',l'<h n 

+ ^^ (^(f, f , f) - ^(<, *o • ^(i, r + 1)), 



where 

^ M (fc,/,T) = -fc.^l- m2 + 3 - 2 - m3 



E. 

j + j) • - n i+i,j Cj+jOj n »,j+i 



E 



and 



5Ni tj {k,l,F) = SN ii:i (l,k,T). 



We note that the formula for (5'rij j can be obtained by considering the flow 
which goes in or out for cell rtjj. 



Reasoning via the Galton- Watson process, we know that the expected 
number of forced moves is j^-. Thus the new expected value of 5 af- 
ter setting a small fraction dt of variables from cell n\- 1 True is: S + 
dt(5ni2,Sm^, 8n) + dtj^(5'm2, S'm^, 5'n). If we set a variable from cell rikj 
False, the expected changes can be obtained by just swapping the role of k 
and I in the above description. 
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